Numerical results for the Edwards- Anderson spin-glass model at low temperature 
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We have simulated Edwards-Anderson (EA) as well as Sherrington-Kirkpatrick systems of L^ 
spins. After averaging over large sets of EA system samples of 3 < L < 10, we obtain accurate 
numbers for distributions p(q) of the overlap parameter q at very low temperature T. We find 
p{0)/T — >■ 0.233(4) as T — >■ 0. This is in contrast with the droplet scenario of spin glasses. We also 
study the number of mismatched links -between replica pairs- that come with large scale excitations. 
Contributions from small scale excitations are discarded. We thus obtain for the fractal dimension 
of outer surfaces of g ~ excitations in the EA model ds — >■ 2.59(3) as T — >■ 0. This is in contrast 
with ds — >■ 3 as T — >■ that is predicted by mean field theory for the macroscopic limit. 



I. INTRODUCTION 



Whether spin glasses are complex systems is an im- 
portant issue. We have discussed this in some detail 
in Ref. [1] where we gave numerical evidence for fun- 
damental differences between the spin-glass phases of 
the Edwards-AndersorP (EA) and of the Sherrington- 
Kirkpatrick'^ (SK) models. In short, we studied spikes 
in probability distributions, p{q), of the overlap param- 
eter, g, that vary widely over different sample systems. 
The variation of a suitably defined average spike width 
w over the values of the linear system sizes L we studied 
was shown to decrease sharply with L in the SK model. 
Furthermore, rms deviations Sp away from p{q) over dif- 
ferent system samples (that is, over different realizations 
of quenched disorder) increase sharply with L. Such be- 
havior is consistent with mean field theory, which pre- 
dicts the replica symmetry breaking (RSB) scenario in 
which w —> and (5j) — > oo in the macroscopic limit .SEI 
Our results^ for the EA model follow a different trend. 
Rather, w and Sp become, within errors, independent 
of L in the zero temperature limit. [The statistics of 
spikes in overlap distributions in different system sam- 
ples, which have been studied by Yucesoy^ et al., also 
point away from an RSB scenario, though this conclu- 
sion is criticized in Ref. 7.] 

Much numerical work on the behavior of the EA 
model at low temperature stems from the observations 
of Moorg^let al., that Monte Carlo simulations had up to 
then been performed at temperatures that were too close 
to the critical temperature, and therefore suffered from 
finite size effects that could be misinterpreted as RSB 
behavior. Low temperature data for p{q), which was the 
centerpiece of these considerations, were soon thereafter 
provided by Katzgraber, Palassini and Young^ (KPY). A 
roughly constant value of p{q ^ 0) over a 3 < i < 8 size 
range was shown to be consistent with the se dat a. This 
is as in the RSB, not the droplet scenaricpSEl] gf spin 
glasses. We did not report data for p{q) in Ref. J], be- 
cause they were essentially the same as KPY's, and our 



statistical errors did not decisively improve on them. We 
have since simulated sample sets which are over an order 
of magnitude larger than KPY's, and cover a range of 
system sizes which is slightly larger. We are thus able to 
report here rather accurate data for temperatures as low 
as 0.16Tsg, where Tsg is the spin-glass transition temper- 
ature. 

In the so called trivial-non-trivial (TNT) picture, pro- 
posed by Krz§,kala and MartirP^l and by Palassini and 
YoungSl (PY), p{q) is size independent in the neighbor- 
hood of q = 0, as in the RSB scenario, but the dimension- 
ality ds of outer surfaces of q ^ excitations is smaller 
than the dimensionality, d, of the space where spins are 
embedded. Values of 2.57 ^ ds ^ 2.62 have been cal- 
culated by PY, KPY, and by Jorg and Katzgraber .El 
However, Contucci et al.l^ have obtained dg = 3 for the 
EA model in three dimensions (3D). This would be in 
accordance with a RSB scenario. These two conflicting 
results were obtained by different methods. Fractions of 
mismatched links (FML) between replica pairs are calcu- 
lated in both methods. Afl 2.57 < d, < 2.62 valuePi^'Sl 
were obtained (but see Ref. UM from the rms deviation 
of the FML from its mean value (over time and system 
samples, as well as over all q). On the other hand, ds — 3, 
was obtained in Ref. [15| from the behavior of the mean 
FML, f,ni{q), for each observed value of q. More specifi- 
cally, the L — )■ oo limit of frni{q ^ 0) was studied in Ref. 
[15] for T > 0.5Tsg. This limit was argued to be nonzero, 
which is what one expects of a space fulfilling surface. 
This conclusion fits with the RSB scenario, and clashes 
with the ones reached in Refs. [HI ESI and[TH 

Most of this paper, is devoted to the fractional number 

of link mismatches, Afmi , it costs to create an excita- 
tion with a —Q < q < Q value. For a more precise defini- 
tion of Afmi , consider first fmi , which is the average 
FML given that g is in a given — Q < q < Q interval. 

Subtraction from /,„; of the average FML given that q 
is not in the ~Q < q < Q interval gives A/^/ . Both 
Afrni and fmi have the same zero temperature limit. 



but we believe A/^; is the natural extension to nonzero 
temperatures of the FML of large-size excitations in the 

ground state. Whereas fmi decreases as T decreases, 

Afmi increases. This enables us to bracket very low 
temperature behavior and confidently make T — ^ ex- 
trapolations. These notions stand out clearly in the frus- 
trated box (FB) model which we define below. 

The plan of this paper is as follows. In Sec. |ll] we 
define the models, the spin-overlap and link-overlap pa- 
rameters, and the simulation procedure. In Sec. |III[ we 
report accurate data for p{q) for EA and SK systems 
at very low temperature. These data show that, in the 
3 < L < 10 range, p{q ^ 0) is independent of L at 
very low temperatures. The conclusion KP V2l reached, 
that the EA model exhibits a clear trend away from the 
droplet scenario, is thus strengthened. In Sec. |IV A| we 
examine the large-scale behavior of the FML in the FB 
model. This simple model helps to highlight the pitfalls 
that should be avoided in the interpretation of a nonzero 
macroscopic limit of FML. In Sec 



IV B 



we assign a (av- 
erage) mismatching-link cost, Af„a , to an excitation 

with a —Q < q < Q value. Numerical results for Afmi , 
which imply a fractal dimension of 2.59(3) for the s urface 

n 

are also given in Sec. 



IV B 



Such 



associated to A/,„; 
a value of d^ , smaller than the dimensionality 3D of the 
space where spins are embedded, is in contradiction with 
mean field th eory p redictions, but is as envisioned in the 
TNT scenariJi^iS of the EA model. We summarize our 
conclusions in Sec. IVl 



II. MODELS, DEFINITIONS AND PROCEDURE 

In all models we study, an Ising spin sits on each one of 
the N = L X Lx L sites of a simple cubic lattice in three 
dimensions (3D). We use periodic boundary conditions 
throughout. In the SK and EA models the interaction 
energy between a pair of spins at sites i and j is given 
by JijCJiaj. We let Jij — ±.1|^/N randomly, without 
bias, for all ij site pairs in the SK model. For the EA 
model, Jij — unless ij are nearest-neighbor pairs, and 
we draw each nearest-neighbor bond Jij independently 
from unbiased Gaussian distributions of unit variance. 

We let all temperatures be given in units of l/Zcs, 
where ks is Boltzmann's constant. Thus, the transi- 
tion temperature Tsg between the paramagnetic and SG 
phase of the SK model is T^g = l.EHl Yot the EA model 
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We let (Tj stand for a spin at site i of replica 1 of a 

(2) 

given system, and similarly, a^ for an identical replica, 
replica (2), of the same system. As usual, we define 

g = iV^iS.g, and g, = af af \ (1) 

that is, q is the average (over all sites) spin alignment 
between the states replicas 1 and 2 are in. 
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TABLE I. Number of samples, Ns, and the number of MC 
sweeps Ts taken for equilibration as well as for subsequent av- 
eraging. The average over samples of the swap success rate, 
a, between EA and SK systems at their two lowest temper- 
atures, and between systems in the critical region of the FB 
system, are also given. (Other swap rates are larger.) 



As in Refs. [T^andfOl we define the link-overlap. 



qi = {Ni)-'j: 



(1) (1) (2) (2) 



(2) 



where Ni is the total number of links, and the sum is over 
all i,j nearest neighbor pairs (of which there are 3N in 
the nearest neighbor EA model in 3D). The FML between 
replicas 1 and 2 is given by fmi = (1 ^ Qi)/"^- In addition, 
as in Ref. [T5| we define fjmi (?) as the time average of the 
FML (for a sample with a given set J of bonds) which 
is observed over all time intervals while the value of the 
spin-overlap is q. Unfortunately, the dimensionality ds of 
large scale excitations does not follow straightforwardly 
from the behavior of fjmi ■ This is because smaller scale 
excitations contribute to fjmi{q)- More on this can be 
found in Sec. IIVI 

Let J^{q) be any q dependent function, such as p{q) or 
fmi{q)- We define 



J'^ 



Q 

(2Q)-i / dqTiq). 

-Q 

=Q 



(3) 



The advantage of working with J- is that statistical er- 
rors for it are smaller than for T{q). Accordingly, most 

results below are given for ]fi and fmi rather than for 
p{q) and fmiil)- How statistical errors on p'3 depend on 
Q is worked out in Appendix [K\ 

In addition, we let Aj stand for the value of some 
observable A on a sample defined by the set J^ of bonds, 
and we let {Aj)j stand for the average over samples of 
A_7. Thus, p{q) = {pj{q))j and [5p{q)]'^ = {[pj{q) - 



iJ- 



J- 



We make use of the parallel tempered MC method.'^^E^l 
Details on how we apply it to the EA and SK model are 
as specified in Ref. [T]. However, some details differ. For 
all sizes of the EA model, temperatures are spaced here 
by 0.04 (0.08) in the 0.16 < T < 0.48 (0.48 <T < 1.6) 
range. The rationale for this, as well as checks we perform 
in order to make sure equilibrium is reached, can be found 
in Appendix |B] Temperatures of all SK systems were 
evenly spaced by AT = 0.04 in the whole 0.12 < T < 
1.6 range. For the FB model, AT = 0.02 (AT = 0.01) 
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FIG. 1. (Color online) Plots of L°-^^fmi and of p vs q, for EA 
systems of L^ spins, for the values of L shown, at T = 0.16. 
For clarity, only a fraction of all data points are shown, but the 
lines shown go through every one of them. The normalization 
condition J-^ dq p(q) = 1 is satisfied. 
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FIG. 2. (Color onhne) Plots of p'^ vs T for EA systems of 
L X L X L spins, for the values of L shown, and Q = 1/4 and 
1/2. Icons for all L < 8 cover their error bars. For better 
visibility of data points, not all of them are shown, but lines 
go through every one of them. 



for all 4 < L < 8 {L — 12). Values for average swap 
success rates, a, between pairs of EA and SK systems at 
the lowest two temperatures are given in Table I. Larger 
values of a are observed for higher temperatures. In the 
FB model, the smallest value of a, which we give in Table 
1, is observed in the critical region. 

The number, Ng, of sample systems we average over, is, 
as specified in Table I, much larger here than in Ref. [T] . 
We have tried not to make Ng smaller with increasing L. 
This is because, as we show in AppendixlAj statistical er- 
rors are independent of L, because of non-self- averaging. 
(For L = 10, we could only do 20 000 samples. That 
took some 50 years worth of computer time.) 



III. AVERAGE g-DISTRIBUTIONS AT LOW 
TEMPERATURES 

Plots oi p{q) vs q are shown in Fig. fllfor EA systems of 
various sizes at T = 0.16. Plots of p'^T vs T are shown 
in Fig. [2] for Q = 1/4 and 1/2. Error sizes are clearly 
smaller for the larger value of Q. Simulation details, such 
as sample numbers and running times, are given in Table 
I. 

For comparison, plots oip'^/T vs T for SK systems of 
various sizes are shown in Fig. [s] for Q = 1/2 and 1/4. 
We note that p'^ ^^ T if T < 0.3T, independently of L, 
following mean field predictions,^ ^° for the SK model. 

For a more accurate picture of how p'^ varies with L 
in the EA model, we show log- log plots of pR /T vs L, 
for Q = 1/4 and T — 0.2 in Fig. l4] For comparison, we 
also show data points from the KPY paper for the same 
temperature and Q = 0.2.^3 

The best fit of jfl a L~^ to the data points shown 
in Fig. |4] gives 6 ~ 0.008. Fits following from letting 
9 = 0.04 and —0.02 give x^ parameters that are over 
twice as large as the one for = 0.008. (See the figure 




FIG. 3. (Color online) (a) Plots oip^ vs T for SK systems of 
L X L X L spins, for the values of L shown, and Q — 1/4 and 
1/2. Icons cover all error bars. 



legend for further details.) For higher temperatures, up 
to T ~ 0.4, as weU as for Q = 1/2 and all T < 0.5, all 
error bars are smaller than the ones shown in Fig. [4j 
and all best fits of p"^ oc L~^ to the data give | 9 \< 0.01. 
Thus, future generation of more accurate data that would 
give 9 > 0.04 for the 3 < L < 10 range is rather unlikely. 

Finally, Q ^ and T — >• extrapolations, give 
p{0)/T -^ 0.51(3) for the SK model. Similarly, p{0)/T -^ 
0.233(4) as r -^ follows from the plots shown in Fig. [2] 
for the EA model. 
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FIG. 4. (Color online) Log-log plots of p*^ vs L for Q = 1/4 
of EA systems at T = 0.2. All • stand for our own MC 
data and the straight line for the best p^ ~ L~^ fit (given 
by e ~ 0.008) to the data. The best fit gives x^ - 3.7, and 
X^ ^ 10 (x^ ==; 8) follows from letting 9 = 0.04 (-0.02). All i 
stand for old data points from KPV'^for the same temperature 
and a slightly lower Q — 0.2 value. [We have divided by 2 
data values from KPY, because their reported values of p{q) 
fulfill L dq p{q) — 1, instead of J_-^ dq p{q) = 1.] 




FIG. 5. (Color online) Plots of Afmi and of fmi , for Q = 
1/2, vs L for FB systems at the T values shown. The dotted 
line is for 2/31/. In the parallel tempered MC setup, L — 8 
FB systems were placed in thermal contact with heat baths 
at equally spaced, by AT, in the 6.5 > T > 0.8 temperature 
range. For all L < 8, AT = 0.02, but AT = 0.01 for L = 12. 



IV. NUMBER OF LINK MISMATCHES WHICH 
COME WITH LARGE SCALE EXCITATIONS 



In this section we give a definition of the fraction of 

mismatches, Afmi , it costs to create an excitation in the 
—Q<q<Q range, where < Q < 1. The simplicity of 
the FB model is helpful in this respect. We introduce this 
nonrandom frustrated model in Sec. IIV Al The definition 
of Afmi as well as the results we obtain for the EA (and 



SK) model are given in Sec. IV B 



A. The frustrated-box model 

We define here a nearest-neighbor Ising model in which 
most bonds are ferromagnetic. For reasons given below, 
we term it the frustrated-box (FB) model. Consider plane 
*Pi, perpendicular to the x axis, at x = 1/2, which cuts 
all bonds between x = 0,y,z, and l,y,z sites. Simi- 
larly, *P2 at a; = L/2 + 1/2, cutting all bonds between 
X — L/2,y,z and L/2 + l,y,z. These planes divide 
the system into two equal portions. In this model, only 
nearest-neighbor spins interact. All bonds, except the 
ones that cut across *Pi and *P2, are of strength 1, that 
is, ferromagnetic. Half the bonds that cut across both 
*Pi and ^2 are of strength —1, that is, antiferromag- 
netic, and the rest are of strength 1. More precisely, all 
±1 bonds that cut across both *Pi and ^2 are distributed 
on a checkerboard pattern. We apply periodic boundary 
conditions. 

In the ground state, all spins within the box (that 
is, between planes ^1 and ^2) are parallel, and so are 
all spins outside the box. These two spin subsystems 



can point in the same or opposite directions. Thus, the 
ground state is (because of invariance under all-spin re- 
versal) four-fold degenerate. The box defined by *Pi 
and *P2 and the system's boundary is the 3D analog 
of Toulouse's two-dimensional frustrated plaquettes.!^ 
Hence, the "frustrated-box" label. 

The number of broken bonds in all ground states of 
the FB model is L^, but the number of bond mismatches 
between two replicas is (in ground states) either or 2L^. 

Thus, fral = 1/3L but fraliq = 0) = 2/3L. PlotS oij^l^ 

vs L are shown in Fig. [slfor Q = 1/2 in FB systems at 

Q 

various temperatures. Note f„ii — 2/3L a.t T — 1, as 
expected for T ^Tc/^ 4.5. 

Curves for T — 2.4 and 2.8 in Fig. [51 clearly hint at 

Q 

a nonzero asymptotic value of fmi ■ The right inter- 
pretation of this result comes easily for the FB model. 
Obviously, it isn't that d^ — >■ 3 as L — >■ cxd. Rather, 

bulk contributions to /,„; , compete with contributions 
(amounting to 2/3L) from the outer surfaces enveloping 
q ^ excitations when L is sufficiently large. Consider, 
for instance, T < 2.5. A exp(— 12/T) fraction of all spins 
point in the "wrong" direction then in large FB systems. 

This is the reason why /,„; must cross over to a size- 
independent value [at L ^ (1/18) exp(12/T) in the FB 

model]. Below, we subtract from /„; unwanted contri- 
butions. 



B. Number of link mismatches which come with 
large scale excitations in the EA model 

Let us first examine a simple picture of large and small 
scale excitations. In Fig. |6J the same cross section of an 
EA sample system of 10"^ spins at T = 0.36 is shown at 
four different times (consecutive times are at least 10^ 
MC sweeps apart) of a single MC simulation. For a 3D 
picture of the outer surface of a large scale excitation in 
an EA system at T = 0.16 see Fig. [7] 

The general idea is to determine the area of the outer 
surface of large scale excitations, such as the ones on both 
right-hand panels of Fig. |6] We intend to do this by sub- 
tracting the total surface area of small scale excitations 
from the total (from small and large excitations) surface 
area. 

For each system sample, we first obtain fj,ni{q) for 
each q by adding 1/2(1 — qi) whenever q is observed in 
a given MC run, and we finally divide the result by the 
number of times q has been observed. Now, the average 
surface area over all excitations observed in a given sam- 
ple whenever a value of q is in the —Q<q<Q range is 
given by. 
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FIG. 6. Maps showing grey (white) squares for sites where 
qi — —1 {qi — +1) on a liorizontal cut of a 10 x 10 x 10 spin 
system. Outer surfaces of large scale excitations are shown 
with thick black lines. Broken lines stand for surfaces of small 
scale excitations. Different panels show maps observed at 
different times (consecutive times are at least 10® MC sweeps 
apart) from a simulation of an EA sample system at T = 0.36. 
The spin-overlap parameter, taken over the whole system, had 
values q ~ 0.98, 0.88, -0.06, -0.06 for the top left, bottom 
left, top right and bottom right panels, respectively, at the 
times these images were recorded. 




FIG. 7. Instantaneous 3D image showing outer surfaces on 
several small- and one large-scale excitation in an EA system 
sample at T = 0.16. Flat surfaces on the framing cubic box 
are not excitation boundaries and should be disregarded as 
such. They arise from our inability to give an appropriate 
pictorial representation of periodic boundary conditions. At 
the time this image was recorded, q ~ 0.495. 

where uj = J_q dq pj{q), and by. 



fjml = {'^lvj) dq fjmliq)pjiq), (5) 

J\q\>Q 

where vj = J. i^pdq pj{q), whenever q is outside the 
— Q < q < Q range. 

Finally, for the average FML it costs to create an ex- 
citation in the —Q < q < Q range, we calculate, 



A/„ 



-Q 



(/. 



Jml 



fj 



ml IJ- 



(6) 



We have calculated (. . .) j in the above equation by each 
of the following two procedures: (1) giving equal weight 
to all system samples for which uj > 0.1, and (2) giv- 
ing each sample a weight proportional to J_Qdq pj{q). 
Within statistical errors, we have obtained the same re- 
sults from these two procedures. 

Thus, NiAfmi is a reasonable definition of the outer 
surface area 6 of an excitation with a —Q < q < Q 
value. This definition excludes contributions from small 
scale excitations. 

We can first check in Fig. [51 for the general behavior 

Q 

of Afjni in the FB model. Data points approximately 
fall on straight lines. Furthermore, all are well fitted by 
Afmi ^ 1/L, thus giving the desired value, ds = 2, for 
the dimension of planes *Pi and ^2, not only as T — > 
but for nonzero temperatures as well. 

Plots of L^'^^ fmiil) vs q are shown in Fig. nlfor EA 
systems of various sizes at T = 0.16. However, departures 
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FIG. 8. (Color online) (a) Plots of fmi vs L, where Q = 1/2, 
for EA systems of L^ spins, for the values of T shown. The 
data points (♦) shown for T = come from extrapolations 
such as the ones shown in Fig. |10| The slope of the dashed 
line going through the T = data points is 0.41. (b) Same as 
in (a) but for Afmi ■ The ♦ data points are the same as in 
(a). 



from such scaling behavior can be observed, even over 
this limited range of system sizes, in analogous plots (not 
shown) for T as small as T > 0.3. This effect is more 

clearly exhibited in Fig. ^a), where plots of fmi vs L 
are shown for Q = 1/2 and various temperatures. 

A qualitatively different picture can be observed in Fig. 
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FIG. 9. (Color online) (a) Plots of fmi vs L, where Q = 1/4, 
for EA systems of L"^ spins, for the values of T shown. The 
data points (♦) shown for T = come from extrapolations 
such as the ones shown in Fig. |10| The slope of the dashed 
line going through the T = data points is 0.41. (b) Same as 

in (a) but for A/^j . The ♦ data points are the same as in 

(a). 
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FIG. 10. (Color on line) Plots of A/„i and fmi vs T for 
Q = 1/4 and the values of L shown. The dotted lines are for 
our T — >■ extrapolations. 



b). In it, plots of A fmi vs L are shown for the same 
Q and T as in Fig. Isla). All data points shown for 

A fmi in Fig. p[b), which include temperatures up to 
T < 0.8, fall on straight lines. Consequently, T — > 
extrapolations of their slope values is straightforward. 
From such extrapolations, we obtain d ~ dg — 0.41(3). 
Within errors, this is in agreement with the value found 
in Refs. [SI [131 and UM bv a different method. 

Incidentally, we note in Figs. Isja) and [sFb) that 

whereas fmi decreases, A fmi increases as T decreases. 
This is as expected, because whereas the number of ex- 
citations (and thus /„,; ) decreases as the temperature 

decreases, the cost {A fmi ) of creating an excitation in- 
creases as the temperature decreases (since higher tem- 
peratures imply a larger number of mismatched links to 
start with). 

For Q = 1/4, plots of fmi and A/,,,.; vs L and var- 
ious temperatures are shown in Figs. [OJJa) andJQJ^b), re- 
spectively. Proceeding as above (for Q — 1/2), we arrive 
at d — dg = 0.41(3). We thus infer this number to hold 
independently of Q in the Q ^ 1/2 interval. 

We can alternatively do a T ^- extrapolation of 

A fmi and fmi for each value of L, as shown in Fig. 
10 for Q = 1/4 and L = 4 and 10. Extrapolations from 



both curves meet, within errors, at the same point, as ex- 
pected. The points thus obtained for Q = 1/2 [Q = 1/4] 
are plotted in Figs, ^a) and[8]^b) [Figs, ^a) and|9];b)]. 
From Log-log plots of the zero temperature curves thus 
obtained, we also obtained d— dg = 0.41(3). 



CONCLUSIONS 



We have reported data for p{q) from averages over large 
sets (numbers are shown in Table I) of EA and SK sys- 



terns at very low temperature. The data for p^ improves 
our confidence level in the conclusion that p{q ~ 0) is 
nonzero and system-size independent in the EA model. 
Future generation of more accurate data that would give 
p(0) ~ l/L'^ and 9 > 0.04 in the 3 < L < 10 range of 
L values is rather unlikely. Thus, the conclusion KPY 
had reached,^ that the EA model exhibits a clear trend 
away from the droplet scenario, is strengthened. Further- 
more, our results are consistent with p{0)/T — > 0.233(4) 
as T -^ in the EA model (and p{0)/T -> 0.51(3) as 
T ^ in the SK model). 

We have studied the fraction of link mismatches, 

^fmi , it costs to create an excitation with a —Q < 
q < Q value. For a wide range of temperatures in 

the spin-glass phase, ^fmi seems to vanish, as in the 
TNT picture,E2l in the macroscopic limit. Data points 

for A/m; (for Q = 1/4 and 1/2) are consistent with 

A^;;'^ - 1/L'^-'^^ for all T < T,g. Furthermore, in 
agreement with results obtained in Refs. [HI [131 and [T3] 
by a different method, wc find d—dg -^ 0.41(3) as T ^^ 0. 
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FIG. 11. (Color online)(a) Plots of 6w{Sp)^ /p'^ vs T for EA 
systems of L linear sizes, as shown, and Q — 1/4. (b) Same 
as in (a) but for the SK model. 



follows. Now, let 
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Appendix A: Error bars 

We show here how statistical errors A{Ng) for p'^ de- 
pend on Ns, on system size, on Q and on T for T <C 1. 

Consider first the rms deviation Sp{q) of the probabil- 
ity density pj{q) from its average over different samples. 
It is plotted vs I g I in Fig. 3 of Ref. [IJ for EA sys- 
tems of various sizes at T = 0.1. Because there is no 
self-averaging, Sp ^ p, except near q = 1. In addition, 
Sp{q)/p{q) does not decrease as L increases. This has an 
unwanted implication, namely, fractional statistical er- 
rors in p{q) do not decrease as system size increases if N^ 
remains constant. 

To start, let Fj{qi,q2) = pj{qi)pj{q2), 

rQ rQ 

Gji.Q\Q)^ dqi j dq2 6{q2-qi-q)Fj{qi,q2), 

Jo Jo 

(Al) 

and let G{q \ Q) be the average of Gj[q \ Q) over sam- 
ples. We can then write. 



A{\f = g-2 f dq G{q I Q) - [pQf 
J-Q 



(A2) 



dq G{q I Q) = wG{0 I Q) 



define w. We also note. 



G(0 I Q) - Qiip'^r + [Spy 



(A3) 



(A4) 



Here, the first term is much smaller than the second 
one for T < 0.5 and all Q < 1/2, in both the EA and 
SK models. This comes from the fact that, whereas p"^ 

vanishes as T — > 0, (Sp)'^ does not. Therefore, A^(l) ~ 



{w/Q){Sp)^ for T < 0.5 and ah Q < 1/2, whence. 



A(iV, 



op 



QNs 



(A5) 



follows immediately. This is clearly consistent with non- 
self-averaging. It shows that A is, at least for the values 
of L we study here, independent of L, for both the EA 
and SK models. Equation ( |A5| ) also shows how much 
precision is gained by averaging p{q) over —Q < q < Q. 

We can substitute into Eq. ( |A5[) the low temperature 

values of wi^SpY Iv^ from Figs. |ll[a) and|ll[b) for the 
EA and SK mo dels , respectively. Further substitutions 
of pQ from Sec. Ill give 



A(7V,) 



/ T 
QNs 



(A6) 



where c ~ 0.2,0.3 for the EA and SK models, respec- 
tively, at low temperatures. This is the desired expres- 
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FIG. 12. (Color online) (a) Plots of the probability p'^/T vs 
lO'^+L/^ (J)/t^ for Q = 1/2 and at least 10'* sample EA systems 
of 6^ spins at T = 0.4. is a scaling number which is chosen 
so all points fall as closely as possible to a single curve. The 
values of AT, swap success rate a for swaps between systems 
at T and T + AT, and (j> are as shown. The coldest system in 
the tempered MC set up from which these data points follow 
was at T = 0.4. (b) Same as in (a) but for systems of 8^ 
spins at T = 0.2, which were the coldest ones in the parallel 
tempered MC set up from which these data points follow. 



Appendix B: Swap success rate and equilibration 

We show here (i) how we choose the success rate, a, 
for state swapping (that is, for exchanging spin configu- 
rations) between two systems, and (ii) how we checked 
equilibration was achieved in our simulations. 

We first derive an e xpres sion for a. In the parallel tem- 
pered MC algorithm,E3i2l the probability, P{ss \ AE), 
for state swapping to take place between systems 1 and 
2, at temperatures Ti, T2, where AE — E2 — Ei, is given 
by, P{ss I AE) = 1 ii AE < 0, but P{ss \ AE) = 



exp{-Al3AE) if AE > 0. Now, 

a= dAE P{ss I A£:) P{AE). 



(Bl) 



In thermal equilibrium, the probability that the energy 
of systems at Ti and T2 differ by AE is given by, 

where, neglecting variations in the specific heat (per spin) 
c in the Ti < T < T2 range, Na'^ is the mean square en- 
ergy deviation coming from thermal fluctuations at both 
Ti and T2, 



E-{E) 



N 



and y 



AE 



cVNAT. 



It then follows that, 

P{AE) : 



-ie-r/4<T^ 



(B3) 



(B4) 



Substitution into Eq. (Bl ) yields, assuming AT <C Ti < 
T2, 



ac^eTic{ATy/cN/2T), 



(B5) 



[erfc(7) = {2/y/TT J°° dx exp(— a;^)]. 

A choice of a w 0.5 might seem t o lea d to efficient 
MC simulations, which, using Eq. (B5|, would lead 

ATVc]V/2T 



0.48. Note however that increasing AT 
does make a smaller, but it also implies fewer random 
steps need be taken by a given state in order to travel 
from a system at the minimum temperature to one at 
the maximum temperature. Furthermore, smaller tem- 
perature differences imply fewer systems to be simulated, 
which leads to further computer time saving 

This point is illustrated in Fig. 12 a 
jP /T vs 10^0/ts are shown for EA systems of 6 x 6 x 6 
spins at T = 0.4. These data points come from tempered 
MC runs of sets of equally spaced temperatures. Values 



where plots of 



of the swap success rate, a, between the two systems at 
the lowest pair of temperatures are given for each AT, 
given by T„+i — T„, in Fig. 12 |a). From the values of 
(j) given in Fig. [l2|a), we conclude that values of a as 



small as 0.2 do not lead significantly slower simulations. 
Figure Fig. ^^h) is as[l2];a) but for L = 8, T^™ = 0.1, 
and X axis values are for lO^/r^. Note even an a value 
as small as 0.04 only slows simulations down by 20%. 
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